%0 Conference Proceedings
%4 sid.inpe.br/sibgrapi/2019/09.09.17.29
%2 sid.inpe.br/sibgrapi/2019/09.09.17.29.19
%@doi 10.1109/SIBGRAPI.2019.00040
%T Alignment of Local and Global Features from Multiple Layers of Convolutional Neural Network for Image Classification
%D 2019
%A Santos, Fernando Pereira dos,
%A Ponti, Moacir Antonelli,
%@affiliation Universidade de São Paulo
%@affiliation Universidade de São Paulo
%E Oliveira, Luciano Rebouças de,
%E Sarder, Pinaki,
%E Lage, Marcos,
%E Sadlo, Filip,
%B Conference on Graphics, Patterns and Images, 32 (SIBGRAPI)
%C Rio de Janeiro, RJ, Brazil
%8 28-31 Oct. 2019
%I IEEE Computer Society
%J Los Alamitos
%S Proceedings
%K feature learning, convolutional networks, fusion multiple maps, manifold alignment.
%X Convolutional networks have been extensively applied to obtain features spaces for classification tasks. Although those achieve high accuracy in many scenarios, typically only the top layers of the network are explored. Hence, a relevant question arises from this fact: are initial layers useful in terms of discriminative ability? In this paper, we leverage the complementary description offered by such first layers. Our method consists of features extraction in multiple layers, followed by feature selection, fusion of feature maps from the different layers, and space alignment. Through an extensive experimentation with different datasets and studying different training strategies, our results show that local information, coming from the first layers, may significantly improve the classification performance when merged with a global descriptor extracted from a top layer of the network. We report different methods for reducing the dimensionality of the local descriptors, and guidelines on how to align them so that to perform fusion. Our study encourages future studies on combining feature maps from multiple layers, which may be relevant in particular for transfer learning scenarios.
%@language en
%3 camera_ready_92.pdf